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ABSTRACT 


A modular CAMAC based system is described which has been 
developed at NASA/ Goddard Space Flight Center to meet a 
variety of precise time and fre t uency measurement and dis- 
tribution needs. The system is based on a generalization 
of the dual mixer concept. By using a 16 channel 100 ns 
event clock, the system can intercompare the phase of 16 
frequency standards with sub -picosecond resolution. The 
system has a noise floor of 26 fs and a long term stabi lity 
on the order of 1 ps or better. The system also uses a 
digitally controlled crystal oscillator in a control loop 
to provide an offsettable 5 MHz output with sub -picosecond 
phase tracking capability. A detailed description of the 
system is given including theory of operation and per- 
formance. Also discussed is a method to improve the 
performance of the dual mixer technique when phase balancing 
of the two input ports cannot be accomplished. 


INTRODUCTION 

This paper describes a modular CAMAC based distribution and measurement 
system developed at NASA/Goddard Space Flight Center to meet a variety 
of precise time and frequency needs. The system grew out of the desire 
to minimize the development effort and costs for three system require- 
ments at Goddard Space Flight Ce er: 

1) a frequency combiner/selector (FCS) capable of providing a 
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reliable 5 MHz output tracked to the average phase of multiple 
atomic frequency standards, hut on time with respect to UTC. 

2) an automated data acquisition system capable of intercomparing 
the phase of multiple atomic frequency standards with sub-pico- 
second resolution and capable of correlating these intercomparisons 
with environmental data and UTC. 

3) a remote measurement and distribution system (RMDS) capable of 
distribtuing the 5 NHz output of a frequency standard to a remote 
site, without degradation in phase stability, for comparisons against 
remote frequency standards. 

System Description 

A block diagram of the generalized measurement and distribution system 
is shown in figure 1. The heart of the system is a phase comparison 
system which works on a generalization of the dual mixer technique.! 

The phase comparison system includes the multiple mixers, the offset 
crystal oscillator and the 100 ns multichannel event clock shown on the 
block diagram. Not shown on the diagram, but essential for proper sys- 
tem operation, are buffer amplifiers which isolate the various 5 NHz 
channels from each other and low noise zero crossing detectors at the 
output of each mixer. This phase comparison system uses the offset 
crystal oscillator to heterodyne into 1 Hz beats 5 NHz inputs from 
sources whose phases are to be monitored. For the purpose of maintaining 
system operation independent of any of the 5 NHz inputs, the offset 
crystal oscillator is left free running. The multichannel event clock 
records the epoch of these beats to 100 ns. As shown in the theory 
section, this effectively records the differences in phase between each 
5 MHz input and the crystal oscillator to a resolution of 0.02ps. By 
taking the difference in epoch between two channels, the data bus con- 
troller can determine the difference in phase between any two 5 NHz 
inputs with this same resolution. The multichannel event clock is also 
used to monitor 1 pps or other TTL pulse sources directly with 100 ns 
resolution. 

The distribution functions of the system are implemented by the D/A 
controlled crystal oscillator (DXCO) and the RF output control shown on 
the diagram. Again, not shown but essential to proper operation, are 
buffer amplifiers in the 5 MIz lines. The frequency of the crystal 
oscillator is controlled via an 18 bit D/A converter with a fractional 
resolution of 7 . 6x10 pgr bit. Since the DXCO output is fed back to 
the phase comparison system, the data bus controller can use the D/A 
converter to control the phase of the DXCO with sub -picosecond resolu- 
tion. Actual phase performance depends on the phase noise of the other 
5 MHz inputs, the phase noise of the crystal oscillator, and the time 
constant of the control loop. The RF output control is essentially 


an RF switch which connects the 5 MIz output to a back up 5 Miz source 
in case of control system failure. 

Data transfer and logical functions are implemented by a data bus con- 
troller. This unit can be a microprocessor built in to the system or an 
external processor. Of course, data output and program control devices 
are also part of the system for comnunication to and from the processor. 

HARDWARE DESCRIPTION 

The data bus chosen was the IEEE and I EC instrumentation standard called 
CAMAC. ^ A CAMAC crate with several of the instrumentation modules is 
shown in figure 2. The advantages of using CAMAC are many fold. First, 
since CAMAC is an IEEE and IEC standard, one can interchange hardware 
from many manufacturers. Existing instrumentation can be used with 
several stand alone microprocessor based bus controllers or can be inter- 
faced to virtually any minicomputer through interface type controllers. 
Second, many off the shelf modules are available to accomplish PTTI 
functions. For example, should the need arise to extend the resolution 
of the event clock, an IEEE 488 (HPIB) interface is available so high 
resolution time interval counters can be used. Alternatively, time 
interpolators with resolutions of 50 ps or better are available which 
can be used in conjunction with the multichannel event clock. Finally, 
the maximum data rate of the bus, 24 Mbps, is more than adequate for 
most purposes. 

The multichannel event clock is shown in figure 3. This clock ?s cap- 
able of recording the epoch of 16 channels of TTL events (positive or 
negative edge selectable for each channel) to 100 ns. Whenever one or 
more events occur during a 100 ns interval, the epoch is recorded in a 
FIFO memory along with a channel identity word. In this way overlap 
and dead time problems are taken care of. The FIFO memory can be read 
as needed by the processor as long as the capacity of the FIFO is not 
exceeded. Epoch is stored to one day. When one day is exceeded 
an interrupt is sent to the processor and a bit is set until the pro- 
cessor resets it. In this way, the processor can keep track of the day 
and year. 

The heart of the system is the analog part of the phase comparison 
system. A brass board is shown in figure 4. This system is also 
modular. The four larger modules are buffered mixers and zero crossing 
detectors. The smallest modules are buffer amplifiers and the inter- 
mediate module is an eight channel driver amplifier. These units 
exhibit very low phase noise (see theory section) and low environmental 
coefficients. Figures 5 and 6 show some typical temperature coefficient 
measurements of a driver amplifier and a buffered mixer. The ouffer 
amplifiers are essentially identical to the driver amplifier. All 
temperature coefficients have been measured at lps/°C or less. 
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Figure 7 shows voltage coefficient measurements. Notice that all 
voltage coefficients are approximately lps/V or less. 

THEORY AND PERFORMANCE 

The phase comparison system is a generalization of the dual mixer phase 
measurement technique shown in figure 8. In this technique, a transfer 
oscillator of nominal angular frequency wo-e is used to heterodyne the 
outputs of two reference oscillators of nominal angular frequency ojq to 
two beats of nominal angular frequency e. As shown in the figure, a 
time interval counter, set up to measure the time difference between the 
zero crossings of the two beats, effectively measures the difference in 
normalized phase (x = <f>/io) between the two reference oscillators multi- 
plied by the factor wo/e. One thing not shown on the diagram but 
essential for cancellation of the phase noise of the transfer oscillator 
is that the time interval between zero crossings be significantly 
shorter than the correlation time of the low pass filters which deter- 
mine the noise bandwidth of the system. 

In the phase comparison system described here, the offset crystal os- 
cillator is the transfer oscillator. Since N reference oscillator inputs 
are involved, a single N channel epoch clock replaces N-l time interval 
counters. This not only reduces the required hardware, as will be 
shown later, this improves system operation under certain operating 
conditions. 

To understand the detailed operation of the phase comparison system, con- 
sider a 5 NHz input or channel i of the form: 

Vi = Ai sin (wot + <J>i (t)) 

and a signal from the transfer oscillator of the form: 

Vj = Arp sin (t>' 0 t + 4>x (t)) 

where all the phase deviation from an ideal signal of angular frequency 
w 0 has been put into tf>i and respectively. The mixer at channel i 
outputs a signal of the form: 

Vm = Am f (<J>T - 4>i) 

where f(x) is a periodic sine like function whose only important 
property is that f (x) =0 at x = mr (n any integer) . The ith zero 
crossing detector outputs a positive going pulse which is recorded as 
an event by the 100 ns clock at time t-[ given by: 

4>T Ui) - 4>i (ti) = 2 tt ni 
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The d : fference in normalized phase (x = <J>/o) 0 ) between channel i and 
channel j , lor n^ = nj , 

is , th ,*n 

Dx (i,j) = x (t ) - x (t ) 

T i 1 J 

where: 

Dx = (<|>. (t.) - 4>.(t.D)/w 
ix j J o 


and: 

xx = 4 >t/ w o 

But: 

x T (t i ) - x^lt..) = y Dt 

where : 


Dt (i,j) = ti - tj 


and y is the fractional frequency offset of the transfer oscillator 
from w 0 averaged over time Dt: 


y 



t. 

i 



dt 


This yields: 


Dx = y Dt 


( 1 ) 


which states that the difference in the phase of any two channels is 
given by the difference in zero crossing times of the beats times the 
fractional frequency offset of the transfer oscillator. 

The stability of tne measurement system over the time T can be charact- 
erized by a two sample variance wf Dx: 

o 2 Dx (2 fc +T)) 2 > 

Using (1), this becom 
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or: 

“at- V2.T.Dt) ( J ) 

where ay is the two sample variance for the fractional frequency varia- 
tions of the transfer oscillator and: 

a = Dt a 

X y 

From . quations (2) or (3) , the stability properties of Dx can be 
examined. For Dt less than, t c , the time constant of the zero crossing 
detectors which determine the noise bandwidth of the system, a v is 
approximately a constant. This means that, for Dt < t c ; apx g&ts 
smaller as Dt gets smaller. In actual practice, this is limited by 
noise introduced by the measurement system itself. In the system 
described (tc = 13 ms, fc = 12 Hz): 

o^ (2, Is, 120is) = 2.7 x10“ 14 s 

Figure 9 shows the long term phase stability. Notice it is on the order 
of 1 ps or better for T up to days. Notice also that during this time 
the transfer oscillator has varied in frequency by almost 10 "10. 

For characterizing the resolution of the phase compai son system when 
measuring frequency, one can form the statistic: 

N 

ojjy (T) = 1 Z (Dx (iT) - 2Dx ((i+1) T) + Dx ((i=2) T)) 2 

4N i=l 

which in the limit of large N becomes the apparent value a v (T) for one 
channel when ideal frequency standards are input to all thfe channels. 

For the data shown in figure 9, ag x and are computed in the 

following chart: 


System Performance 
(system bandwidth = 12 Hz) 


(S) 

N 

a Dx 

(10~ 14 s) 

°MY 

.99 

100 

2.73 

3. 3x10 " 14 

9.9 

100 

3.41 

3.9xlO-J5 

99 

1498 

10.4 

7.4x10'}° 

990 

148 

28.0 

3.1xl0' 16 

9900 

13 

71.2 

5.2xl0* 17 

10 5 

(estimated) 

100 

7x10' 18 
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The value at 10 seconds is estimated on the basis of a few days 

observed performance. A graph of °MY is shown in figure 10. \ 

For Dt greater than tc, one can see from (2) or (3) that the phase 
noise of the transfer oscillator becomes important. There are two 
components associated with this phase noise, a short term component 
associated with Dt and a long term component associated with T. That 
is, for T > > Dt: 

° 2 Dx = (° 2 y (Dt) + a 2 y (T)) 

Figure 11 shows this behavior for the case where Dt is about equal to 
the 1 Hz offset of the transfer oscillator. In figure 11, the "raw 
phase" is Dt times the average value of y over the time of the plot. 

Notice that the raw phase has a short term noise component greater than 
the "phase" of figure 10. Notice also that, for this worst case, the 
phase tracks the crystal transfer oscillator with about 1 ps for every 
part in 10^2 change in frequency. 

There is a method, however, for taking out the long term component due 
to changes in the transfer oscillator. Since the total ep>och of each 
channel is recorded, the frequency of the crystal relative to any 
channel can be obtained at any time by taking the difference in epoch 
of the zero crossings of that channel. To obtain the best estimate of 
the crystal frequency, one can use the channel with the lowest noise 
input, the average of many channels, or the average over many zero 
crossings. Using this estimate of the transfer oscillator frequency, 

Y , a good estimate of Dx can be obtained: 

Dx* = y* Dt (4) 

The error in this estimate is give by the difference between (1) and 
(4): 

Dx-Dx' = Dt (y - y') (5) 

By using a running estimate for y’ , all the long term effects of trans- 
fer oscillator changes can be taken out. This is shown in the 
"corrected phase" of figure 11. 

SYSTEM APPLICATIONS 

The most stringent application for the measurement and distribution 
system is the Data Acquisition Facility shown in figure 12. This 
facility's principle task is to intercompare many hydrogen masers with 
subpicosecond resolution, to monitor their phase against UTC, and to 
measure the effects of environmental factors on these masers. For 
this purpose the CAMAC module is interfaced to a PDP11 computer. Corn- 
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parisons with UTC are made via TV and LORAN-C. 
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Another application is the Frequency Combiner/Selector (FCS) shown in 
figure 13. The FCS will use the phase comparison system and DXCO to 
track a 5 MHz signal to the average phase of multiple cesium frequency 
standards with a frequency offset. The frequency offset will be 
adjusted in a secondary phase lock loop to keep the 5 f-Hz on time with 
respect to UTC measured via NASA's own Tracking Data Relay Satellite 
System (TDRSS) or LORAN-C. The processor will carry out fault analysis 
on all parts of the system and modify system behavior to minimize the 
consequence of any fault. 

A third application is a remote distribution and measurement system. 

As envisioned now, this system will monitor a 5 MHz signal sent from a 
main site down a cable and return the same 5MHz to 
the main site via a parallel cable. By monitoring the changes in phase 
down both cables, the main site will be able to determine a correction 
to bring the remote 5 NHz in phase with the 5 Mlz at the main site. 

This information will be sent via modem to the remote system to control 
its DXCO. The main use of this system will be to intercompare remote 
frequency standards without loss of stability. 
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Figure 1. Distribution and Measurement System 









Figure 2. CAMAC Crate 
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Figure 4. Phase Comparison System 





Figure 5. Temperature Coefficient of Driver Amplifier 







Figure 6. Temperature Coefficients of Buffer-Mixer 
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Figure 7. Voltage Coefficients 
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Figure 8. Dual Mixer System 
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Figure 9. Phase Comparison System Performance (Dt = 120us) 
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Figure 11. Phase Comparison System Performance (L = 990 ms) 
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Figure 13. Frequency Combiner/Selector 







QUESTIONS AND ANSWERS 

DR. HELMUT HELLWIG, National Bureau of Standards: 

Can the system or at least parts of it be procurred? If so, how and 
for how much? 

DR. REINHARDT: 

That is another reason we went to CAMAC. The only essential part 
of the system that cannot be procurred off the shelf at this time; 
that is, the digital parts of the system, is the 100 nanosecond 
clock. 

One thing I didn't mention because time was short was you buy 
what are called klugeboards, which essentially give you all the hard- 
ware and all the interfacing to the CAMAC. And you only wire what 
you need. And we have wi rewrap lists. In fact, if you want 

one of these 100 nanosecond clocks, contact us because we have been 
having them wi rewrapped outside. It is just a matter of us sending 
you the drawings and the wire lists. And you can go to the same 
company that we did and get it wi rewrapped. The price? Bob, what 
was the price of the 100 nanosecond clock? 

SPEAKER: About $1 ,000. . . 

DR. REINHARDT: 

That's for the CAMAC crate itself. In fact, 
you can get that as a full-blown RT 11 operating system with floppy 
discs for about $12,000. But the microprocessors themselves cost 
about $3,000 or $4,000. The CAMAC crate is about $1,500. 

My rule of thumb is, it is $1,000 per module--per completed 
module, not klugeboard. The analog parts of the system are, as 
you can see, also modular. We are making them in-house now. But 
again, if anybody wants any drawings or anything like that, they 
should contact us. We have printed circuit board layouts. Thank 
you. 

DR. CARROlL ALLEY, University of Maryland: 

How many cesium standards do you plan to include in your ensemble? 

DR. REINHARDT: 

We have the optimum ensemble for statistical analysi s--two. That 
way, nobody can tell if anything is wrong. Right now we plan to 
use two. And you obviously get a factor of two improvement in reli- 
ability. The idea is to also at least divide the phase by a 

square root of two while you are doing that. And I have an ulterior 
motive in this. You can plug a hydrogen maser directly into that 
system and have it work. It will reproduce the phase specs of a 
hydrogen maser. 
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DR. SAMUEL STEIN, National Bureau of Standards: 

You can accomplish very much the same results, to remove the insta- 
bilities of a common oscillator and to gain the benefit of an event 
clock, in a small system in hardware, by locking your transfer 
oscillator to one of your references. 

MR. DAVID W. ALLAN, National Bureau of Standards: 

In addition to that, if you get an oscillator which has very little 
phase noise over the beat interval, in your case one second, the 
noise then becomes immaterial regardless of the phase. We have 
chosen as one system at NBS to use a 500 hertz beat and a very low, 
high-quality low-phase noise oscillator. And the phase noise just 
doesn't enter in. 

DR. REINHARDT: 

I would like to add a comment to that. The data were actually taken 
without the full-blown system, and now with these programmable cal- 
culators and counters, we just set the counter to alternately meas- 
ure time interval and period. And so you can effectively do the 
same thing on a small system with a conventional dual mixer system 
by just changing the software. 
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